Large pre-trained, zero-shot capable models have shown considerable success both for standard transfer and adaptation tasks, with particular robustness towards distribution shifts. In addition, subsequent fine-tuning can considerably improve performance on a selected downstream task. However, through naive fine-tuning, these zero-shot models lose their generalizability and robustness towards distribution shifts. This is a particular problem for tasks such as Continual Learning (CL), where continuous adaptation has to be performed as new task distributions are introduced sequentially. In this work, we showcase that where fine-tuning falls short to adapt such zero-shot capable models, simple momentum-based weight interpolation can provide consistent improvements for CL tasks in both memory-free and memory-based settings. In particular, we find improvements of over $+4\%$ on standard CL benchmarks, while reducing the error to the upper limit of jointly training on all tasks at once in parts by more than half, allowing the continual learner to inch closer to the joint training limits.

人心脏的准确几何定量是诊断多种心脏疾病的关键步骤，以及心脏患者的治疗。超声成像是心脏成像的主要方式，但是采集需要高操作员的技能，由于工件，其解释和分析很困难。在3D中重建心脏解剖结构可以使发现新的生物标志物，并使成像降低对操作员专业知识的依赖，但是大多数超声系统仅具有2D成像功能。我们提出了对PIX2VOX ++网络的简单变化，以大大降低存储器使用和计算复杂性，以及从2D标准心脏视图中对3D解剖结构进行重建的管道，从而有效地从有限的2D数据中启用了3D解剖学重建。我们使用合成生成的数据来评估管道，从而从只有两个标准的解剖学2D视图中获得准确的3D全心重建（峰值相交> 0.88）。我们还使用真实的回声图像显示了初步结果。